Two-Sample Covariance Matrix Testing And Support Recovery
نویسندگان
چکیده
This paper proposes a new test for testing the equality of two covariance matrices Σ1 and Σ2 in the high-dimensional setting and investigates its theoretical and numerical properties. The limiting null distribution of the test statistic is derived. The test is shown to enjoy certain optimality and to be especially powerful against sparse alternatives. The simulation results show that the test significantly outperforms the existing methods both in terms of size and power. Analysis of prostate cancer datasets is carried out to demonstrate the application of the testing procedures. When the null hypothesis of equal covariance matrices is rejected, it is often of significant interest to further investigate in which way they differ. Motivated by applications in genomics, we also consider two related problems, recovering the support of Σ1 −Σ2 and testing the equality of the two ∗Tony Cai is Dorothy Silberberg Professor of Statistics, Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA 19104 (Email:[email protected]). Weidong Liu is Professor, Department of Mathematics and Institute of Natural Sciences, Shanghai Jiao Tong University, Shanghai, China and Postdoctoral Fellow, Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA 19104 (Email: [email protected]). Yin Xia is Ph.D student, Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA 19104 (Email: [email protected]). The research was supported in part by NSF FRG Grant DMS-0854973.
منابع مشابه
Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings
Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings Tony Cai a , Weidong Liu b & Yin Xia a a Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA, 19104 b Department of Mathematics, Institute of Natural Sciences and MOE-LSC, Shanghai Jiao Tong University, Shanghai, China Accepted author version posted online: 02...
متن کاملA multiple testing approach to the regularisation of large sample correlation matrices
This paper proposes a regularisation method for the estimation of large covariance matrices that uses insights from the multiple testing (MT ) literature. The approach tests the statistical signi cance of individual pair-wise correlations and sets to zero those elements that are not statistically signi cant, taking account of the multiple testing nature of the problem. By using the inverse of t...
متن کاملTesting Some Covariance Structures under a Growth Curve Model in High Dimension
In this paper we consider the problem of testing (a) sphericity and (b) intraclass covariance structure under a Growth Curve model. The maximum likelihood estimator (MLE) for the mean in a Growth Curve model is a weighted estimator with the inverse of the sample covariance matrix which is unstable for large p close to N and singular for p larger than N . The MLE for the covariance matrix is bas...
متن کاملTesting proportionality of two large-dimensional covariance matrices
Testing the proportionality of two large-dimensional covariance matrices is studied. Based on modern random matrix theory, a pseudo-likelihood ratio statistic is proposed and its asymptotic normality is proved as the dimension and sample sizes tend to infinity proportionally.
متن کاملTests for covariance matrices in high dimension with less sample size
In this article, we propose tests for covariance matrices of high dimension with fewer observations than the dimension for a general class of distributions with positive definite covariance matrices. In one-sample case, tests are proposed for sphericity and for testing the hypothesis that the covariance matrix Σ is an identity matrix, by providing an unbiased estimator of tr [Σ] under the gener...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011